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METHOD AND APPARATUS FOR EVALUATING RESULTS OF 
MULTIPLE SOFTWARE TOOLS 



BACKGROUND OF THE INVENTION 

Field of the Invention 
The present invention generally relates to a method and apparatus for 
improving the design or analysis solution for complicated problems solved by 
alternative software tool packages. 

Description of the Related Art 
In a design or analysis problem for a complicated problem such as a VLSI 
(Very Large-Scale Integration) circuit, a designer (e.g., in a generic problem, a 
decision maker) would preferably apply two or more design or analysis tools and 
then select the preferred solution. However, a problem with this conventional 
approach is that typically the decision maker or designer does not have easy access 
to all of the alternative software tool packages that provide a solution. Nor is it 
particularly desirable for a decision maker or designer to personally exercise 
multiple design or analysis tools since this would require obtaining and maintaining 
these tools, training all operators for all of these tools, and paying for multiple 
tools. 
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A specific example is the problem of synthesizing a VLSI hardware 
description (such as GL1) from a high level description of the artifact such as 
VHDL (VHSIC Hardware Description Language) or Verilog. Multiple tools from 
multiple vendors are available to solve this problem. Yet, for the reasons 
mentioned above, the selection of the "best" solution in the current state of the art 
is limited to the generation and selection of the preferred solution within a single 
vendor tool, because a designer does not usually have access to multiple vendors' 
repertoire of tools. Additionally, because of budgetary constraints, a designer may 
not even have access to all of the most appropriate tools within a single vendor's 
repertoire. 

Although not intended as a total listing, other examples of complex 
problems in which multiple software tool packages might be used to provide a 
solution are: 

- creating a schedule of classes in a high school; 

- creating a distribution schedule of goods; and, 

- creating a structure for a design of a building. 

In all of the above examples, a user would typically have a software tool to 

exercise the problem and, without the benefit of the present invention, would be 

left with a single solution based on a single specific software tool or vendor's set 

of tools. Hence, the solution would not be optimized and would not take 

advantage of the infrastructure of multiple tools. 
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SUMMARY OF THE INVENTION 



In view of the foregoing and other problems, it is, therefore, an object of 
the present invention to provide a structure and method for providing access for 
decision makers to various available tools and selecting the preferred solution 
automatically. 

It is another object of the invention to provide value to the decision maker 
by providing access to the best available solution amongst a plurality of available 
solutions from different tools and/or vendors. 

It is another object of the invention to provide a system where a decision 
maker submits a problem or design data (preferably via the Internet) to a single 
vendor who, for a fee prepares a solution and returns the solution to the circuit 
designer, based upon having utilized all appropriate tools within the vendor's 
repertoire of design, analysis, and layout tools. 

It is another object of the invention to provide a system where a decision 
maker submits his problem or design data (preferably via the Internet) to a single 
provider of services who, for a fee prepares a solution and returns the solution to 
the circuit designer, based upon having utilized all appropriate tools within 
multiple vendors' repertoires of design, analysis, and layout tools. 
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In a first aspect of the present invention, a method for optimizing a solution 
for a complex problem solvable by a plurality of software tool packages is 
described in which problem data is selectively converted into a format appropriate 
for at least one preselected vendor's set of software tools, the formatted problem 
5 data is inputted into at least one preselected vendor's set of software tools, and, if 
more than one vendor has been preselected, the results (the resultant solutions) are 
compared and an optimum solution is selected based on a criteria provided in the 
problem data. 

In a second aspect of the present invention, a system for determining an 
10 optimized solution to a problem solvable by software tools is described in which 
there is a means for converting the problem description into a format suitable for a 
software tool package for a plurality of predetermined vendors, each software tool 
package including at least one software tool, a means for exercising the problem 
data on the plurality of vendors 5 software tool packages, and a means for ranking 
1 5 results of the plurality of vendors' software tool packages. 

In a third aspect of the present invention, a system for determining an 
optimal solution to a problem solvable by software tools is described which 
includes a first computer terminal permitting an originator to enter data describing 
the problem to be solved, the data including a criteria for verification and 
20 comparison, and to transmit the problem data to at least one other computer, and 
at least one second computer capable of receiving the problem data from the first 
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computer, where the at least one second computer contains at least one software 
tool package for exercising the problem data, and the at least one second computer 
additionally capable of transmitting a result of exercising the problem data to either 
the first computer or to a predesignated third computer. 

In a fourth aspect of the present invention, a system for optimizing the 
solution of a complex problem solvable by software tool packages includes an 
interface permitting an operator at a first computer to enter a problem description, 
the problem description including a verification criteria and a comparison criteria, 
an interface to permit the operator to transmit the problem description from the 
first computer to a second computer, an interface permitting the second computer 
to receive the transmitted problem description, a software tool using the 
verification criteria to verify a solution of the problem description, a software tool 
using the comparison criteria to determine a ranking of any solutions of the 
problem description, and an interface to transmit said ranking back to the first 
computer. 

In a fifth aspect of the present invention, a computer readable medium 
contains instructions executable by a computer for an interface permitting an 
operator at a first computer to enter a problem description, the problem 
description including a verification criteria and a comparison criteria, an interface 
to permit the operator to transmit the problem description from a first computer to 
a second computer, an interface permitting the second computer to receive the 
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transmitted problem description, a software tool using the verification criteria to 
verify a solution of the problem description, a software tool using the comparison 
criteria to determine a ranking of any solutions of the problem description, and an 
interface to transmit the ranking back to the first computer. 

In a sixth aspect of the present invention, a computer readable medium 
contains instructions executable by a computer for a selective convertion of a 
problem data into a format appropriate for at least one preselected vendor's set of 
software tools, an inputting of the formatted problem data into at least one 
preselected vendor's set of software tools, and, if more than one vendor has been 
preselected, a comparison of results of resultant solutions and a selection of an 
optimum solution based on a criteria provided in the problem data. 

With the unique and unobvious aspects of the invention, a better solution is 
obtained to complex problems solved by software tools by analyzing the solutions 
from multiple solution providers. Using the invention a decision maker has access 
to solutions based on multiple vendors' software packages. This access and 
improvement in result are not currently available. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, aspects and advantages will be better 

understood from the following detailed description of preferred embodiments of 

the invention with reference to the drawings, in which: 
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Figure 1 is a diagram representing conventional solutions to a specific 
example of the type of software-tool applications that would benefit from the 
invention, that of providing access to VLSI design tools; 

Figure 2 is a flow diagram illustrating a first exemplary embodiment of the 
5 invention, using the VLSI specific example; 

Figure 3 is a flow diagram illustrating a second exemplary embodiment of 
the invention, using the VLSI specific example; 

Figure 4 is a flow diagram illustrating the generic application of an 
exemplary embodiment of the invention; 
10 Figure 5 is a flow diagram illustrating the generic application of a second 

exemplary embodiment of the invention; and 

Figures 6 and 7 illustrate an exemplary hardware implementation of the 
invention. 



DETAILED DESCRIPTION OF PREFERRED 
EMBODIMENTS OF THE INVENTION 



To explain the invention in concrete form, the following discussion will 
first focus on one possible example in which the invention can be applied, that of 
VLSI design. It is noted that additional possible non-limiting applications are 
20 described above. That is, having read the following description, a person of 
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ordinary skill in the art will readily understand the concept and could easily tailor 
and apply the invention to other specific examples. 

Referring now to the drawings, and more particularly to Figure 1, the 
problem of synthesizing a VLSI hardware description (such as GL1) from a high 
level (such as VHDL or Verilog) description of the circuit is illustrated by 
reference numeral 10 as involving one or more design tools. This process may be 
done in-house by the designer or may be subcontracted to be performed outside 
the designer's company by a solutions provider 12, perhaps using an intranet or the 
Internet as a communications link. 

An exemplary method of the invention to improve the final design solution 
is illustrated by reference numeral 20 in figure 2. A plurality of suppliers' tools 22, 
each of which provides a solution 24, receives the VHDL description of the 
problem. Typical vendors providing tools would be, for example, Synopsys, Inc., 
Cadence Design Systems, Inc., Mentor Graphics, Inc., and Cascade Design 
Automation, Inc. From these solutions 24, selection process 26 determines which 
is optimal and provides result 28 as an output ultimately returned to the circuit 
designer. The optimal solution is determined by a set of parameters provided by 
the circuit designer along with possibly a set of relative weights for these 
parameters. Parameters a circuit designer might consider important and would 
provide to the solutions provider along with the VHDL description might include, 
for example: chip area, chip power, number of mask layers and/or number of 
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process steps required to manufacture the chip, anticipated manufacturing yield, 
and chip speed or frequency. In addition to permitting a ranking of the design 
solutions, this listing of parameters may also serve to verify that each vendor 
solution provides acceptable solutions for the listing of parameters. Therefore, the 
circuit designer might also include a range of values that she considers acceptable. 
VLSI tool packages typically have measurement capability for numerous 
parameters so that this verification exercise would be obvious to one of ordinary 
skill in the art. Finally, selection process 26 may include verification tools such as 
tools that verify functional equivalence of the GL1 and VHDL and tools that 
conduct design rule checking (DRC) on the GL1 . 

As an example of the ranking process, suppose vendor A software tool 
package provides a solution having area A , power A , no_layers A , yield A , and 
frequency A and vendor B tool package provides area B , power B , no_layers B , yields, 
and frequency B . The circuit designer has indicated a weighting of parameters: 
area 10%, power 50%, nojayers 10%, yield 20%, and frequency 10%. A number 
of formulas could be used to rank the design results according to these criteria. 
One example would be the following. The solution from vendor B ranks above the 
solution from vendor A if 

f(area A /area B ) x 0. 1 + f(power A /power B ) x 0.5 + f(no_layers A /no_layers B ) x 
0.1 + f(yield B /yield A ) x 0.2 + f(frequency B /frequency A ) x 0.1 >■ 0, 

where f(x) = x if x > 1 and f(x) = - 1/x if 0 -< x -< 1. 
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A second exemplary method 30 is shown in figure 3. A plurality of 
solutions providers 32 each provide their solution 34. Preferably these solutions 
providers 32 receive the VHDL circuit description via the Internet and provide 
specific solution 34 via the Internet to a common program 36 providing an analysis 
to determine which solution 34 is optimal. Optimal solution 38 is output to the 
circuit designer, preferably via Internet. 

The present invention is preferred because a better solution is obtained by 
analyzing the solutions from multiple solution providers. In the case of the 
example (GL1 from VHDL), selecting the preferred solution requires evaluating 
multiple solutions against the same metrics (such as cost and performance) which 
is preferably done again using multiple analysis programs. 

Figure 4 shows an exemplary embodiment of the invention as applied to a 
generic application. The decision maker sends a statement of the problem to be 
solved to a solution provider who will exercise up to N vendors' software tool 
packages (40). The specific format for this input problem statement from the 
decision maker might depend upon the tools used by each specific vendor's tool 
package. However, the problem statement conversion would more likely be done 
by the solutions provider as a preliminary process in exercising the respective 
vendor's tool package (42). 

Having exercised the vendor's software package, the solutions provider 
then measures the quality of the solution from that vendor's package (44), ranks 
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the various measures (46), and returns the ranked solutions to the decision maker 
(48). As above for the VLSI example, the ranking may be based on a listing of 
parameters provided by the decision maker as part of the problem description. 
Parameters that might be used for ranking the solutions for the problem of creating 

5 a schedule of classes in a high school might include: number of classrooms, 

number of students that cannot have preferred set of classes, number of teachers 
that cannot teach preferred grades, and number of hours the school must be open. 
The parameters that might be used for ranking solutions for the creation of a 
distribution schedule of goods might be: number of drivers, number of trucks, and 

1 0 longest route. In the example of creating a structure for a building design, 

parameters might include: number of different parts needed, number of worker 
hours for assembly, and total cost of parts. 

Figure 5 illustrates another embodiment of the generic process of the 
invention. In this embodiment, the decision maker sends the problem description 

1 5 along with evaluation criteria to a number of vendors (51), perhaps via the 

Internet. Each vendor j finds a best solution using their tool package (53) and 
sends that vendor solution to a designated solutions provider (55). The designated 
solutions provider ranks the vendor solutions (57) using the same design 
evaluation criteria originally provided by the decision maker and returns the ranked 

20 solutions to the decision maker (59). 
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Figure 6 illustrates a typical hardware configuration of an information 
handling/computer system for use with the invention and which preferably has at 
least one processor or central processing unit (CPU) 61 1. 

The CPUs 61 1 are interconnected via a system bus 612 to a random access 
5 memory (RAM) 614, read-only memory (ROM) 616, input/output (I/O) adapter 
618 (for connecting peripheral devices such as disk units 621 and tape drives 640 
to the bus 612), user interface adapter 622 (for connecting a keyboard 624, mouse 
626, speaker 628, microphone 632, and/or other user interface device to the bus 
612), a communication adapter 634 for connecting an information handling system 
10 to a data processing network, the Internet, an Intranet, a personal area network 
(PAN), etc., and a display adapter 636 for connecting the bus 612 to a display 
device 638 and/or printer 639 (e.g., a digital printer or the like). 

In addition to the hardware/software environment described above, a 
different aspect of the invention includes a computer-implemented method for 
1 5 performing the above method. As an example, this method may be implemented in 
the particular environment discussed above. 

Such a method may be implemented, for example, by operating a 
computer, as embodied by a digital data processing apparatus, to execute a 
sequence of machine-readable instructions. These instructions may reside in 
20 various types of signal-bearing media. 
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Thus, this aspect of the present invention is directed to a programmed 
product, comprising signal-bearing media tangibly embodying a program of 
machine-readable instructions executable by a digital data processor incorporating 
the CPU 61 1 and hardware above, to perform the method of the invention. 
5 This signal-bearing media may include, for example, a RAM contained 

within the CPU 61 1, as represented by the fast-access storage for example. 
Alternatively, the instructions may be contained in another signal-bearing media, 
such as a magnetic data storage diskette 700 (Figure 7), directly or indirectly 
accessible by the CPU 611. 
1 o Whether contained in the diskette 700, the computer/CPU 6 1 1 , or 

elsewhere, the instructions may be stored on a variety of machine-readable data 
storage media, such asDASD storage (e.g., a conventional "hard drive" or a RAID 
array), magnetic tape, electronic read-only memory (e.g., ROM, EPROM, or 
EEPROM), an optical storage device (e.g. CD-ROM, WORM, DVD, digital 
15 optical tape, etc.), paper "punch" cards, or other suitable signal-bearing media 

including transmission media such as digital and analog and communication links 
and wireless. In an illustrative embodiment of the invention, the machine-readable 
instructions may comprise software object code, compiled from a language such as 
"C", etc. 
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With the unique and unobvious features of the present invention, a better 
solution is obtained to complex problems solved by software tools by analyzing the 
solutions from multiple solution providers. Using the invention a decision maker 
has access to solutions based on multiple vendors' software packages. This access 
and improvement in result are not currently available. 

While the invention has been described in terms of preferred embodiments, 
those skilled in the art will recognize that the invention can be practiced with 
modification within the spirit and scope of the appended claims. 
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